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Abstract 

A search for the decay B^-^K^K^tt^ was performed using data collected by the OPAL 
detector at LEP. These decays are strongly suppressed in the Standard Model but could occur 
with a higher branching ratio in supersymmetric models, especially in those with R-parity 



violating couplings. No evidence for a signal was observed and a 90% confidence level upper 
limit of 1.29 x 10~^ was set for the branching ratio. 
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1 Introduction 



Rare b decays offer an opportunity to discover new physics beyond the Standard Model (SM). 
Many studies have been done in recent years to predict ffavor changing neutral current (FCNC) 
processes, both within the SM and beyond [||. One of these FCNC induced processes, b— i>s7, has 
been measured and the branching ratio found to be consistent with the SM prediction 0. 
However, significant uncertainties still remain in both the theoretically predicted branching 
ratio and the measurement. Thus it is hard to conclude if this process shows signs of new 
physics This is also true in most of the channels such as b— >sqq and h^sil @], due to 
theoretical uncertainties. 

The process b— >ssd, induced by a box diagram, is predicted to be exceedingly small in the 
SM (Figure |l|(a)), of the order of 10~^^ 0. However, in the minimal supersymmetric standard 
model (MSSM) this transition can be induced by the squark-gaugino (or higgsino) box 
diagrams (Figure ||(b)) at a level of 10~^ — 10~®. An alternative mechanism for this channel 
in supersymmetric models is through R-parity violating couplings (Figure |^(c)). These two 
possibilities appear to be the only ones that will produce significant enhancement of this decay 
within supersymmetric models 0. Two higgs doublet models could also induce this decay at 
branching ratios significantly larger than in the Standard Model, for a certain range of the 
parameters involved flOl . 

Typical exclusive processes of b— >ssd include B^^K^ K", which are difficult to separate 
from the standard penguin process b^dss. Although the interference of these two sources of 
the final state is crucial in the study of phenomena such as CP violation, this channel is not 
suitable for a direct search for new physics. However the decay B~— i>K~K~7r"'"Q, either as a 
direct three-body decay or through a K*-like resonance, is a clear signature of this process. 
This document describes the first search for the decay B^^K^K^tt^. 
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Figure 1: b^ssd transition (a) SM, (b) MSSM, (c) MSSM with R-parity violating coupling. 



^charge conjugation is assumed throughout this paper 
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2 Hadronic Event Selection and Simulation 



We used data collected at LEP by the OPAL detector |TT| between 1990 and 1995 running at 
center-of-mass energies in the vicinity of the TP peak. Hadronic Z° decays were selected using 
the number of charged tracks and the visible energy in each event as in Reference [|1^. This 
selection yielded 4.41 million hadronic events. 

Monte Carlo events were used to determine the selection efficiency, for training of an arti- 
ficial neural network (ANN) used in selecting the final event sample (Section and for the 
determination of some of the systematic uncertainties (Section p. To determine the selection 
efficiency we generated 100 000 Monte Carlo events of the process Z°^bb where one of the b 
quarks hadronised into a meson which subsequently decayed to K^K^tt^. One sample was 
generated according to three-body decay phase space, while another sample was generated with 
angular distribution as expected from a weak decay matrix element. In addition, we generated 
samples in which the B meson decayed via an intermediate K* resonance. K*(892), K*(1680) 
and K*(2045) resonances were chosen as they all decay into K~7r+ and cover the entire spectrum 
of K* resonances. 

For optimisation of the selection of events and for some of the studies of systematic uncer- 
tainties, we generated 4 million 5-fiavour hadronic Z° decays (referred to as qq Monte Carlo). 
All these samples were generated with the JETSET 7.4 Monte Carlo program with param- 
eters tuned to the OPAL data IT^. The heavy quark fragmentation was parameterised by the 



fragmentation function of Peterson et al. , and all samples were processed with the OPAL 
detector simulation package ITB 



3 Analysis Procedure 

In each event, charged tracks and electromagnetic clusters not associated to a charged track 



were combined into jets, using the JADE algorithm with the EO recombination scheme ||T7 



Within this algorithm jets are defined by ?/cut = 0.04, where y^nt is defined in Reference |T7 . 

The primary vertex of the event was reconstructed using the charged tracks in the event 
and the knowledge of the position and spread of the e^e~ collision point. 

We searched the hadronic event sample for the decay B~— s>K^K^7r+ by combining three 
charged tracks to form a B meson candidate. All three track combinations were considered. All 
tracks were required to have a momentum of at least 2 GeV/ c and to be in the same jet. Two of 
the tracks were required to have the same charge and were assigned the mass of a kaon. A third 
track, with an opposite charge, was assumed to be the pion. Tracks were required to satisfy 
selection criteria based on the measured rate of energy loss due to ionisation {dE/dx) |]l8l as 
listed in Table 1. These dE/dx selection criteria are 44% efficient while rejecting 98.5% of the 
background. 

The three tracks were fitted to a common vertex and the decay length, the distance from 
the e+e~ interaction point to the reconstructed secondary vertex, was calculated. Candidates 
where the secondary vertex is in the hemisphere opposite to the candidate's jet were rejected. 
This criterion left 55% of the remaining background events, but kept 96% of the signal events. 

Since the hadronic data sample consisted mostly of non-bb events, we suppressed these 
events by means of a b-tagging algorithm, based on reconstructed displaced secondary vertices. 
An artificial neural network with inputs based on decay length significance, vertex multiplicity 
and invariant mass information |T9[ was used to select vertices with a high probability of coming 



from b hadron decays. Events were accepted if any of the jets were tagged by the neural network. 
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Selection 


71 selection 


K selection 


dE/dx-,, 
dE/dxK 
dE/dxp 

NdE/dx 


> 1.15a 
> 20 


< -1.29(T 
±1.55(T 

> 

> 20 



Table 1: Summary of dE/dx selection criteria: dE/dXj^i^K) is the difference between the mea- 
sured value of the ionisation energy loss in the jet chamber and the expected value for tt (K) 
and cr represents the expected standard deviation of the distribution. N^E/dx is the number of 
jet chamber hits used for dE/dx. The dE/dx cuts were chosen based on probability values. 



The b-tagging selection was found to be 79% efficient, while rejecting 80% of the remaining 
background. 

The final selection was based on an artificial neural network designed to select B~— >K~K~7r"'" 
events while rejecting background events. We used the JETNET 3.4 program |2^ with a feed- 
forward type net, trained with the back-propagation algorithm. The neural network used seven 
input parameters: the momenta of the three tracks (p,r, Pk)', the B candidate momentum (pb); 
the ratio of B candidate energy to the jet energy (Xjet); the decay length; and the vertex 
probability, the probability of the three tracks to originate from a common vertex which is 
calculated using the track parameters. The neural network retains 74% of the signal events 
and rejects 97% of background events when selecting candidates with an ANN output above 
0.9. Figure ^ shows the distributions of the artificial neural network input parameters and the 
ANN output for candidates passing the above criteria. While the data and the qq Monte Carlo 
show good agreement, one can clearly observe the differences between these distributions and 
those of the signal Monte Carlo. 

Candidates were accepted if their invariant mass was in the region: 5.10 GeV/c^ < Mkktt 
< 5.46 GeV/c^, which corresponds to twice the mass resolution around the nominal B~ mass. 
Only one candidate per jet was accepted, based on the largest neural network output for can- 
didates in a jet. Figure]^ (a) shows the invariant mass distribution of the K'K^7r+ candidates. 
No enhancement is seen in the signal region, where 17 events were observed. Monte Carlo 
studies indicated that 88% of the background at this stage consists of bb events. 

If the decay chain B~— »-K~K~7r"'" is assumed to be direct (i.e., without an intermediate K* 
resonance), then the mass of the K~7r"'" system can be exploited to further reduce background 
where the pion and one of the kaons are from the decay of a K* resonance. The mass of the 
K~7i~^ system was added as an input to the neural network, and the training procedure of 
the ANN was repeated. Figure |^ (b) shows the invariant mass distribution of the K~K~7r"'" 
candidates passing the selection. Here too, no enhancement is seen in the signal region and the 
observed 14 events are used to determine an upper limit on the branching ratio. 

3.1 Background Estimation 

The background to the process B^^K^K^vr^ was estimated by fitting a second-order poly- 
nomial to the invariant mass of a combinatorial background, obtained by releasing the ANN 
cut, and then normalising the shape to the mass side-bands of Figure ^ (4-5 GeV/c^ and 5.6- 
6 GeV/c^). Monte Carlo studies indicated that the background shape is not altered by this 



6 




0.2 0.4 0.6 0.8 1 

T — n — I I I I I — I I I I I — n — I I I I 




O 

a 

O 

1 

^ .2 

10 



0.2 0.4 0.6 0.8 1 

Pb 



I I I I I I I I I I I I I I I I I I I =1 



e) 




0.25 0.5 0.75 1 
Vertex prob. 



M I I I I I I I I I I I I I I I I I I 



10 



10 



g)l 




I I I I I 



0.25 0.5 0.75 1 
ANN output 



0.1 
0.05 


0.15 
0.1 
0.05 


0.6 
0.4 
0.2 




I I I 



I I I I I I I I I I I I I I I 







0.2 0.4 0.6 0.8 1 

Pk 



J 1 1 1 




1 1 1 1 1 1 1— 

,..d)i 


Z_ J 

m » m - 
• • • ~ 


1 ~ ^ 

',-v;' 1 , , , 1 


I" ' 

1 - 

•i ' ~ 
1 1 in*'^^^^*-^ 



0.2 0.4 0.6 0.8 1 



X 



jet 



I I I I I I I I I I I I I I I I I I I -I 



f) 



I I I I 



0.25 0.5 0.75 1 
Decay length 



• Data 
- qqMC 
Signal MC 



OPAL 



Figure 2: Input variables to the artificial neural network (a-f) and output (g). The solid line 
represents the qq Monte Carlo while the dots represent the data. The dashed line shows the 
distribution of B~— >K*°(892)K~ Monte Carlo events. The arrow in (g) shows the cut value. All 
variables are normalised and are plotted after appropriate transformation to the range [0 — 1]. 
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Figure 3: Invariant mass distribution of the K~K~7r''" candidates after all selection criteria were 
applied a) via intermediate K* resonance and b) with direct production. The dots represent 
the data, the solid line shows the expected signal shape from Monte Carlo events after all the 
selection criteria were applied with arbitrary normalisation, and the dashed line is the expected 
background. 
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procedure. Alternatively, we repeated this procedure by releasing each of the selection criteria 
separately and by obtaining the shape from Monte Carlo. All the alternative fits gave a con- 
sistent result. We also took the number of events within the signal region in each of the above 
cases and scaled it to the appropriate sample size. Here too, all estimates were consistent. 

As we are setting upper limits, the conservative approach is to estimate the number of signal 
events using the lowest background estimate. While the fitted background shown in Figure ^ 
(a) gave 18.8 events in the signal region, the lowest estimate was 17.5 events. The respective 
numbers for the direct production case were 14.8 and 14.1 events. 



3.2 Limit Determination 

The above numbers were used to determine N^°, the 90% C.L. upper limit on the number of 
signal events. Using the formalism of reference |2T|, we obtained N^^ = 7.8 and N^^ = 7.4 
events for the resonant / direct decay, respectively. 

To calculate an upper limit on the branching ratio we used: 

Br(B" ^ K-K"7r+) < , (1) 

where A^b is the number of charged B mesons in the sample and e is the efficiency for Monte Carlo 
simulated events of the process B~— i>K~K~'7r"'" to survive the selection procedure. With 4.41 
million hadronic Z° decays, using Br(b^B±) = 0.397i[J:[]i and T^b/rhad = 0.2170 ±0.0009 |22|, 
we obtained A'b=759 8001^^^[][|. 

The conservative approach when setting upper limits is to use the model giving the low- 
est efficiency for the signal. If one assumes resonance production, then the lowest efficiency, 
8.11±0.19%, is obtained when assuming the signal decay channel is via K*°(892). The lowest 
efficiency for non-resonant decay, obtained with a phase space particle distribution, was found 
to be 11.3±0.2%. 



4 Systematic Uncertainties 

Systematic uncertainties may arise from the limited accuracy with which Ab is known, from 
the uncertainty in the simulation used to determine the efficiency and from the background 
estimation. 

Modelling of dE/dx 

To estimate the uncertainty arising from the modelling of the dE/dx selection criteria, we com- 
pared the efficiency of the dE/dx cuts in Monte Carlo simulated events and in data. We took 
advantage of the abundance and relative ease of reconstruction of D*"*" mesons, and exploited 
them for testing the systematic uncertainties associated with the dE/dx selection criteria. We 
searched for D*"*" mesons via their decay into a D° and a vr"*", where the decays via a K~7r"'". 
To enhance the signal to background ratio we required the momentum of the D*"*" candidate to 
be larger than 15 GeV/ c; the D*"*" decay vertex to be at least 50 /xm away from the interaction 
point; and the helicity angle, 6*, between the kaon momentum in the D rest frame and the D 
direction in the laboratory frame to satisfy cos^* < 0.7. Background estimation, after applying 
these selection criteria, was done as in [^. To avoid possible uncertainty due to the difference 
in the momentum spectrum of the D*'^ products with respect to the momentum spectrum of 
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tracks from the process B^^K^K^tt^, we reweighted the dE/dx selection efficiency as a func- 
tion of the track momenta. By applying the dE/dx criteria used to select the kaon we obtained 
an efficiency of 56.2% in data and 57.0% in Monte Carlo. The respective values for the pion 
selection efficiency are 75.0% and 76.8%. Combining all numbers, the relative uncertainty on 
the signal efficiency associated with the dE/dx cuts is estimated at 3.7%. 



Artificial neural network uncertainty 

The agreement is good between the data and the qq Monte Carlo, in all of the input variables to 
the ANN (Figure |^). However, the Monte Carlo simulation compared in that figure represents 
the background and is not used in setting the upper limit. The simulation used to set the 
limit is that of signal events and thus, signal input variables should be compared. This is not 
possible for the decay B~— >^K~K~7r"'". Therefore, once again we made use of the D*"*" signal. 
We compared the kaon and pion momentum distribution, the D*"*" momentum and fraction of 
energy from the jet's energy, the decay length and the vertex probability. Good agreement was 
achieved between the data and Monte Carlo as shown in Figure ^. Events were reweighted as 
a function of the track momenta to reflect the signal spectrum as in the dE/dx uncertainty 
section, and the ANN output was evaluated. In order to assign a systematic uncertainty to the 
efficiency of the ANN, we took the difference between the fraction of D*"*" events passing the 
ANN cut in the data to that in the qq Monte Carlo. We obtained an uncertainty of 4.1%. In 
addition, we took the difference in the ANN efficiency obtained for the signal involving different 
K* resonances. This difference was found to be 2.1% and the overall uncertainty assigned for 
this source was 4.6% 



B hadron lifetime and decay multiplicity 

The probability to reconstruct the signal B^ meson from also depends on the efficiency to 
reconstruct secondary vertices in both hemispheres. This in turn is sensitive to the charged 
decay multiplicity and lifetime of the B hadrons. The Monte Carlo was reweighted to reflect the 



measured multiplicities and lifetimes |22|. The uncertainty on these figures gave an uncertainty 



of 1.1% and 1.3%, respectively, on the selection efficiency. 



Detector modelling 

The resolution of the tracking devices has an effect on the efficiency. The simulated resolutions 
were varied by ±10% relative to the values that optimally describe the data following the 
studies in |]2^. The analysis was repeated and the efficiency estimation was recalculated. This 
source contributed an uncertainty of 1.2%. 



Fragmentation modelling 



The heavy-quark fragmentation was simulated using the function of Peterson et al. |]T5|. The 
heavy-quark fragmentation model parameter was varied to change the mean scaled energy 
of weakly-decaying bottom hadrons within the experimental range: {xe)^ = 0.702 ± 0.008 
P^ . This change resulted in a 2% change in the efficiency. In addition, the heavy-quark 
fragmentation model was changed to that suggested by Collins and Spiller [^] and to that 
of Kartvelishvili et al. ||26|, with parameters tuned according to Reference - 
change in the resulting efficiency was observed. 



No significant 
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Figure 4: Comparison of ANN input variables for D*"*" candidates. The solid line represents 
the qq Monte Carlo and the dots are the data. 
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Background estimation uncertainty 



The uncertainty on the fitted shape parameters and on the normalisation gave an uncertainty 
on the background estimate. The different techniques used to estimate the background resulted 
in consistent estimates with a small standard deviation (about 1 event). However, since we used 
the lowest background estimate, these uncertainties were not taken into account as they were 
smaller than the difference between the mean background estimate and the one used. 



5 Results 

Combining all sources of systematic uncertainties mentioned above, as well as the statistical 
uncertainty in determining the efficiency and the uncertainty on A^b-, "we obtained an uncer- 
tainty of 8.4% on the denominator of Equation This uncertainty was incorporated according 
to the method outlined in reference [^]. With N^^^ = 7.8 events and N^^ ^.^^ = 7.4 events we 
obtained: 

Br(B- ^ K-K-7r+) < 1.29 x 10"^ @ 90% C.L. 

Br(B" K"K"7r+) non - resonance < 8.79 x 10~^ @ 90% C.L. 



6 Summary 



We have searched for the decay of charged B mesons to K~K^7r^. This decay channel is 
strongly suppressed in the Standard Model, but may be large in R-parity violating models. 
Hence, this decay mode may serve as a probe for new physics beyond the Standard Model. No 
evidence has been observed for such a decay. Upper limits on the branching ratio have been 
set of 1.29 X 10~^, or of 8.79 x 10~^ if one assumes that the decay is not via a K* resonance, 
both at 90% confidence level. 

Using these limits, and the estimate ^ ~b^ss5 ^ ~ i [05 can put new limits on the 
contribution of R-parity violating couplings in this process. Starting from Equation 9 of refer- 
ence ifzi, 



512(27r)3 



^n=l. 



2 '^n32^n21 



^n=l , 



m 



2 ^nl2^n23 



where rrih is the mass of the b quark, /qcd = (ctsi'mh) / ctsi'mun))'^'^^'^^ , rriy^ is the mass of the 
sneutrino involved and A' is a dimensionless coupling. As an example, with mt = 4.5 GeV/c^, 
/qcd ~ 2, rriy^ = 100 GeV/c^ as in and t^- = 1.65 ps we obtain: 



I v3 \' \'* 12 I I V3 \/ \'* 12 ^ c; Q V 1 
I^n=l^n32'^n2ll "r I ^n=l^nl2^n23 1 ^ ^ ) 

which can be compared to the existing limit of 0.1 obtained from b— ssd [0 and neutrino mass 



calculation 29 . 
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